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(54) Title: HAPTIC FEEDBACK FOR TOUCHPADS AND OTHER TOUCH CONTROLS 



(57) Abstract: A haptic feedback planar 
tuuch control used to provide input to 
a computer (10). A touch input device 
includes a planar touch surface that inputs 
a position signal to a processor of the 
computer (10) based on a location of 
user contact on the touch surface. The 
computer (10) can position a cursor in a 
graphical environment (8) based at least 
in part on the position signal, or perform 
a different function. At least one actuator 
is also coupled to the touch input device 
and outputs a force to provide a haptic 
sensation to the user contacting the touch 
surface. The touch input device can be 
a touchpad separate from the computer's 
display screen (12), or can be a touch 
screen. Output haptic sensations on the 
touch input device can include pulses, 
vibrations, and spatial textures. The touch 
input device can include multiple different 
regions to control different computer 
functions. 



wo 01/54109 Al lllfliWIilllllMllillliBlillllllliilll 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations " appearing at thebegin-- 
ning of each regular issue of the PCT Gazette. 


wo 01/54109 PCTAJSOl/01486 

HAPTIC FEEDBACK FOR TOUCHPADS 
AND OTHER TOUCH CONTROLS 


BACKGROUND OF THE INVENTION 

The present invention relates generally to the intCTfacing with compute and mechanical 
devices by a user, and more particularly to devices used to inter&ce with computer systems and 
electronic devices and which provide haptic feedback to the user. 

Humans interface with electronic and mechanical devices in a variety of applications, and 
the need for a more natural, easy-to-use, and informative interface is a constant concern. In the 
context of the present invention, humans interface with computer devices for a variety of 
applications. One such apphcation is interacting with computer-generated environments such as 
games, simulations, and application programs. Computer input devices such as mice and 
trackballs are often used to control a cursor within a graphical environment and provide input in 
these applications. 

In some interface devices, force feedback or tactile feedback is also provided to the user, 
collectively known herein as "haptic feedback." For example, haptic versions of joysticks, 
- — mice, gamepads, steering wheels, or other types of devices can output fences to the user based on 
events or interactions occurring within the graphical environment, such as in a game or other 
apphcation program. 

In portable computer or electronic devices, such as laptop conq)uters, tnice typically too 
large a workspace to be practical. As a result, more compact devices such as trackballs are often 
used. A more popular device for portable computers are "touchpads," which are small 
rectangular, planar pads provided near the keyboard of the computer. The touchpads senses the 
location of a pointing object by any of a variety of sensing technologies, such as capacitive 
sensors or pressure sensors that detect pressure apphed to the touchpad. The user contacts the 
touchpad most commonly with a fingertip and moves his or her finger on the pad to move a 
cursor displayed in the graphical enviromnent. In other embodiments, the user can operate a 
stylus in conjunction with the touchpad by pressing the stylus tip on the toucl5)ad and moving 
the stylus. 

One problem with existing touchpads is that there is no haptic feedback provided to the 
user The user of a touchpad is therefore not able to experience haptic sensations that assist and 
inform the user of targeting and other control tasks within tbe graphical environment. The 
touchpads of the prior art also cannot take advantage of existing haptic-enabled software run on 
the portable computer. 

1 
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SUMMARY OF THE INVENTION 


The present invention is directed to a haptic feedback planar touch control used to 
provide input to a computer system. The control can be a touchpad provided on a portable 
computer, or can be a touch screen found on a variety of devices. The haptic sensations output 
on the touch control enhance interactions and manipulations in a displayed graphical 
enviroimient or when controlling an electronic device. 

More specifically, the present invention relates to a haptic feedback touch control for 
inputting signals to a computer and for outputting forces to a user of the touch control. The 
control includes a touch input device including an q)proximately planar touch surface operative 
to input a position signal to a processor of said computer based on a location of user contact on 
the touch surface. The computer positions a cursor in a graphical environment displayed on a 
display device based at least in part on the position signal. At least one actuator is also coupled 
to the touch input device and outputs a force on the touch input device to provide a haptic 
sensation to the user contacting the touch surface. The actuator outputs the force based on force 
information output by the processor to the actuator. 

The touch input device can be a touchpad separate from a display screen of the computer^, 
or can be included in a display screen of the computer as a touch screen. The touch input device 
can be integrated in a housing of the computer or handheld device, or provided in a housing that 
is separate from the computer. The user contacts the touch surface with a finger, a stylus, or 
other object. The force is preferably a linear force output approximately perpendicularly to a 
plane of the touch surface of the touch input device, and the actuator can include a piezo-electric 
actuator, a voice coil actuator, a pager motor, a solenoid, or other type of actuator. In one 
embodiment, the actuator is coupled between the touch input device and a groxmded surface. In 
another embodiment, the actuator is coupled to an inertial mass, wherein said actuator outputs an 
inertial force on the touch input device approximately along an axis perpendicular to the planar 
touch surface. A touch device microprocessor separate from the main processor of the computer 
can receive force information from the host computer and provide control signals based on the 
force information to control the actuator. 

The haptic sensations, such as a pulse, vibration, or spatial texture, are preferably output 
in accordance with an interaction of a controlled cursor with a graphical object in the grapWcal 
environment. For example, a pulse can be output when the cursor is moved between menu 
elements in a menu, moved over said icon, or moved over a hyperlink. The touch ii^ut device 
can include multiple different regions, where at least one of the regions provides the position 
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signal and at least one other region provides a signal that is used by the computer to control a 
differrait function, such as rate control ftmction of a vahie or a button press. Different regions 
and bordCTS between regions can be associated with different h^tic sensations. 

The present invention advantageously provides haptic feedback to a planar touch control 
device of a computer, such as a touchpad or touch screen. The haptic feedback can assist and 
inform the user of interactions and events within a graphical user interface or other environment 
and ease cursor targeting tasks. Furthermore, the invention allows portable computer devices 
having such touch controls to take advantage of existing haptic feedback enabled software. The 
haptic touch devices disclosed herein are also inexpensive, compact and consume low power, 
allowing them to be easily incorporated into a wide variety of portable and desktop computers 
and electronic devices. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following specification of the invention and a study of the 
several figures of the drawing. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 is a perspective view of a haptic touchpad of the present invention; 

FIGURE 2 is a perspective view of a remote control device including the^touchpad of the 
present invention; 

FIGURE 3 is a perspective view of a first embodiment of flie touchpad of the present 
invention including one or more actuators coupled to the underside of the touchpad; 

FIGURE 4 is a side elevational view of a first embodiment of the present invention in 
which a piezo-electric actuator is directly coupled to the touchpad of the present invention; 

FIGURE 5 is a side elevational view of a second embodiment of the touchpad of the 
present invention including a linear actuator; 

FIGURE 6 is a side elevational view of a third embodiment of the touchpad of the 
present invention having an inertial mass; 

FIGURE 7 is a top plaa view of an example of a touchpad of the present invention 
having differmt control regions; and 

FIGURES 8a and 8b are top plan and side cross sectional views, respectively, of a touch 
screen embodiment of the present invention. 
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TIFT An.V.D DESCRIPTION OF PREFERRED EMBODIMENTS 


FIGURE 1 is a perspective view of a portable computer 10 including a haptic touchpad 
of the present invention. Computer 10 is preferably a portable or "laptop" computer that can be 
carried or otherwise transported by the user and may be powered by batteries or other portable 
energy source m addition to other more stationary power sources. Computer 10 preferably runs 
one or more host apphcation programs with which a user is interacting via peripherals. 

Computer 10 may include the various input and ou^ut devices as shown, including a 
display device 12 for outputting graphical images to the user, a keyboard 14 for providing 
character or toggle input from the user to the computer, and a touchpad 16 of the present 
invention. Display device 12 can be any of a variety of types of display devices; flat-panel 
displays are most common on portable computers. Display device 12 can display a graphical 
environment 18 based on application programs and/or operating systems that are running, such 
as a graphical user interface (GUI), that can include a cursor 20 that can be moved by user input, 
as well as windows 22, icons 24, and other graphical objects well known in GUI enviroimients. 
Other devices may also be incorporated or coupled to the computer 10, such as storage devices 
-^(hard disk drive,.DYD-ROM drive, etc.), network server or cUents, game controllers, ^etc. In 
alternate embodiments, the computer 10 can take a wide variety of forms, including computing 
devices that rest on a tabletop or other surface, stand-up arcade game machines, other portable 
devices or devices worn on the person, handheld or used witii a single hand of the user, etc.. For 
example, host computer 10 can be a video game console, personal computer, workstation, a 
television "set top box" or a "network computer", or other computing or electronic device. 

Touchpad device 16 of tiie present invention preferably appears externally to be similar 
to the touchpads of the prior art. Pad 16 includes a planar, rectangular smooth surface that can 
be positioned below the keyboard 14 oh the housing of the computer 10, as shown, or may be 
positioned at other areas of the housing. When the xiser operates the computer 10, the user may 
conveniently place a fingertip or other object on the touchpad 16 and move the fingertip to 
correspondingly move cursor 20 in the gr^hical environment 18. 

In operation, the touchpad 16 inputs coordinate data to the maia nada:oprocessor(s) of 
the computer 10 based on the sensed location of an object on (or near) the touchpad. As with 
many touchpads of the prior art, touchpad 16 can be capacitive, resistive, or use a difTerent type 
of sensing. Some existing touchpad embodiments are disclosed, for example, in U.S. Patent 
Nos. 5,521,336 and 5,943,044. C^acitive touchpads typically sense the location of an object on 
or near the surface of the touclq>ad based on capacitive coupling between capacitors in the 
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touchpad and the object. Resistive touchpads are typically pressxire-sensitive, detecting the 
pressure of a finger, stylus, or other object against the pad, where the pressure causes conductive 
layers, traces, switches, etc. in the pad to electrically connect. Some resistive or other types of 
touchpads can detect the amount of pressure applied by the user and can use the degree of 
pressure for proportional or variable input to the computer 10. Resistive touchpads typically are 
at least partially defonnable, so that when a pressure is applied to a particular location, the 
conductors at that location are brought into electrical contact Such deformabihty can be useful 
in the present invention since it can potentially amphfy the magnitude of output forces such as 
pulses or vibrations on the touchpad as used in the present invention. Forces can be ampUfied if 
a tuned compliant suspension is provided between an actuator and the object that is moved. 
Capacitive touchpads and other types of touchpads that do not require significant contact 
pressure may be better suited for the present invention in many embodiments, since excessive 
pressure on the touchpad may in some cases interfere with the motion of the touchpad for haptic 
feedback. Other types of sensing technologies can also be used in the touchpad. Herein, the 
temi "touchpad" preferably includes the surface of the touchpad 16 as well as any sensing 
apparatus included in the touchpad xmit. 

Touchpad 16 preferably operates similarly to existing touchpads, where the speed of 
the fingertip on the touchpad correlates to the distance that the cursor is moved in the graphical 
environment. For example, if tihe user moves his or her finger quickly across the pad, the cursor 
is moved a greater distance than if the user moves the fingertip more slowly. If the user's finger 
reaches tiie edge of the touchpad before the cursor reaches a desired destination in that direction, 
then the user can simply move his or her finger off the touchpad, reposition the finger awa:y fi-om 
the edge, and continue moving the cursor. This is an "indexing" function similar to lifting a 
mouse off a surface to change the offset between mouse position and cursor. Furthermore, many 
touchpads can be provided with particular regions that are each assigned to particular functions 
that can be unrelated to cursor positioning. Such an embodiment is described in greater detail 
below with respect to Fig. 7. In some embodiments the touchpad 16 may also allow a user to 
"tap" the touchpad (rapidly touch and remove the object from the pad) in a particular location to 
provide a command. For example, the user can tap or "double tap" the pad with a finger while 
the controlled cursor is over an icon to select that icon. 

In the present invention, the touchpad 16 is provided with the ability to output haptic 
feedback , such as tactile sensations to the user who is physically contacting the touchpad 16. 
Various embodiments detailing the stmcture of the haptic feedback touchpad are described in 
greater detail below. Preferably, the forces output on the touchpad are linear (or approximately 
linear) and oriented along the z-axis, approximately perpendicular to the surface of the touchpad 
16 and the top siutface of computer 10. In a different embodiment, forces can be applied to the 
touchpad 16 to cause side-to-side (e.g., x-y) motion of the pad in the plane of its surface iri 
addition to or instead of z-axis motion, although such motion is not preferred. . 
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Using one or more actuators coiq)led to the touchpad 16, a variety of haptic sensations, 
can be output to the user who is contacting the pad. For example, jolts, vibrations (varying or 
constant amplitude), and textures can be output. Forces output on the pad can be at least in part 
based on the location of the finger on the pad or the state of a controlled object in the graphical 
enviromnent of the host computer 10, and/or independent of finger position or object state. Such 
forces output on the touchpad 16 are considered "computer-controlled" since a microprocessor 
or other electronic controller is controlling the magnitude and/or direction of the force output of 
the actuator(s) using electronic signals. Preferably, the entire pad 16 is provided with haptic 
sensations as a single unitary member; in other embodiments, individually-moving portions of 
the pad can each be provided with its own haptic feedback actuator and related transmissions so 
that haptic sensations can be provided for only a particular portion. For example, some 
embodiments may include a touchpad having different portions that may be flexed or otherwise 
moved with respect to other portions of the pad. 

In other embodiments, the touchpad 16 can be provided in a separate housing that is 
connected to a port of the computer 10 via a cable or via wfreless transmission and which 
receives force information &om and sends position information to the computer 10. For 
example. Universal Serial Bus (USB), Firewhe, or a standard serial bus can connect such a 
touchpad to the computer 10. In such an embodiment, the computer 10 can be any desktop or 
stationary computer or device and need not be a portable device. 

One or more buttons 26 can also be provided on the housing of the computer 10 to be 
used in conjunction with the touchpad 16. The user's hands have easy access to the buttons, 
each of which may be pressed by the user to provide a distinct input signal to the host computer 
12. Typically, each button 26 corresponds to a similar button found on a mouse input device, so 
that a left button can be used to select a graphical object (cUck or double click), a right button 
can bring up a context menu, etc. In some embodiments, one or more of the buttons 26 can be 
provided with tactile feedback and/or kinesthetic force feedback. Other features of these 
disclosures may also be used with the present invention. 

Furthermore, in some embodiments, one or more moveable portions 28 of the housing 
of the computer device 10 can be included which is contacted by the user when the user operates 
the touchpad 16 and which can provide haptic feedback. Thus, both the housing can provide 
haptic feedback (e.g., through the use of an eccentric rotating mass on a motor coupled to the 
housing) and the touchpad 16 can provide separate haptic feedback. This allows the host to 
control two different tactile sensations simultaneously to the xiser; for example, a vibration of a 
low fi-equency can be conveyed through the housing to the user and a higher frequency vibration 
can be conveyed to the user through the touchpad 16. Each other button or other control 
provided with haptic feedback can also provide tactile feedback independently from the other 
controls. 
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The host application program(s) and/or operating system preferably displays graphical 
images of the environment on display device 12. The software and environment rtmning on the 
host computer 12 may be of a wide variety. For example, the host appUcation program can be a 
word processor, spreadsheet, video or computer game, drawing program, operating system, 
graphic^ user interface, simulation, Web page or browser that implements HTML or VRML 
instructions, scientific analysis program, vurtual reality training program or application, or other 
^plication program that utilizes input from the touchpad 16 and outputs force feedback 
conmiands to the touchpad 16, For example, many games and other appUcation programs 
include force feedback functionality and may commmiicate with the touchpad 16 using a 
standard protocol/drivers such as I-Force®, FEELit®, or Touchsense™ available from 
Immersion Corporation of San Jose, California. 

The touchpad 16 can include circuitry necessary to report control signals to the 
microprocessor of the host computer 10 and to process command signals fi-om the host's 
microprocessor. For example, appropriate sensors (and related circuitry) are used to report the 
position of the user's finger on the touchpad 16. The touchpad device also includes circuitry that 
receives signals firom the host and outputs tactile sensations in accordance witibi the host signals 
using one or more actuators. In some embodiment's, a sqparate, local microprocessor can be 
provided for the touchpad 16 to both rq)OTt touchpad sensor data to the host and/or to cany out 
force commands received fix)m the host, such commands including, for example, tiie type of 
haptic sensation and parameters describing the commanded haptic sensation. Altematively, tbe 
touchpad microprocessor can simply pass streamed diata firom the main processor to the 
actuators. The term ''force information" can include both commands/parameters and streamed 
data. The touchpad microprocessor can implement haptic sensations independently after 
receiving a host command by controlling the touchpad actuators; or, the host processor can 
maintain a greater degi-ee of control over the haptic sensations by controlling the actuators more 
directly. In other embodiments, logic circuitry such as state machines provided for the touchpad 
16 can handle haptic sensations as directed by the host main processor. Architectures and 
control methods that can be used for reading sensor signals and providuig haptic feedback for a 
device are described in greater detail in U.S. Patent No. 5,734,373. 

FIGURE 2 is a perspective view of another embodiment of a device which can include 
the active touchpad 16 of the present invention. The device can be a handheld remote control 
device 30, which the user grasps in one hand and manipulates controls to access the functions of 
an electronic device or appliance remotely by a user (such as a television, video cassette recorder 
or DVD player, audio/video receiver, Intemet or network compute connected to a television, 
etc.). For example, several buttons 32 can be included on the remote control device 30 to 
manipulate fimctions of the controlled apparatus. A touchpad 16 can also be provided to allow 
the user to provide more sophisticated directional input. For example, a controlled apparatus 
may have a selection screen in which a cursor may be moved, and the touchpad 16 can be 
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manipulated to control the cursor in two dimensions. The touchpad 16 includes the ability to 
output haptic sensations to the user as desaibed herem, based on a controlled value or event. 
For example, a volume level passing a mid-point or reaching a maximum level can cause a pulse 
to be output to the touchpad and to the user. 

In one application, the controlled apparatus can be a computer system such as* Web-TV 
from Microsoft Corp. or other computing device which displays a graphical xiser interface and/or 
web pages accessed over a network such as the Intemet The user can control the direction of the 
cursor by moving a finger (or other object) on the touchpad 16. The cursor can be used to select 
and/or manipulate icons, windows, menu items, graphical buttons, slider bars, scroll bars, or 
other graphical objects in a graphical user interface or desktop interface. The cursor can also be 
used to select and/or manipulate graphical objects on a web page, such as links, images, buttons, 
etc. Other force sensations associated with graphical objects are described below witii reference 
to Fig. 7. 

FIGURE 3 is a perspective view of a first embodiment 40 of a touchpad 16 of the 
present invention for providing haptic feedback to the user. In this embodiment, one or more 
piezoelectric actuators 42 are coupled to the underside of the touchpad 16. The piezoelectric 
actuator 42 is driven by suitable electronics, as is well known to those skilled in the art. In one 
embodiment, a single piezoelectric actuator 42 is positioned at or near the center of the toucl^ad 
16, or off to one side if space constraints of the housing require such a position. In other 
embodiments, multiple piezoelectric actuators 42 can be positioned at different areas of tiie 
touchpad; the dashed lines show one configuration, where an actuator 42 is placed at each comer 
of the pad 16 and at the center of the pad. 

The piezoelectric actuators 42 can each output a small pulse, vibration, or texture 
sensation on the touchpad 16 and to the user if the user is contacting the touchpad. The entire 
touchpad 16 is preferably moved with the forces output by actuator(s) 42. Preferably, the forces 
output on the touchpad are hnear (or ^proximately linear) and along the z-axis, approximately 
perpendicular to the smface of the touchpad 16 and the top surface of computer 10. In a 
different embodiment, as mentioned above, forces can be applied to the touchpad 16 to cause 
side-to-side (e.g., x-y) motion of the pad in the plane of its surface in addition to or instead of z- 
axis motion. For example, one linear actuator can provide motion for the x-axis, and a second 
linear actuator can provide motion for the y-axis and/or the x-axis. 

The frequency of a vibration output by an actuator 42 can be varied by providing 
different control signals to an actuator 42. Furthermore, the magnitude of a pulse or vibration 
can be controlled based on the applied control signal. If multiple actuators 42 are provided, a 
stronger vibration can be imparted on the touchpad by activating two or more actuators 
simultaneously. Furthermore, if an actuator is positioned at an extreme end of the touchpad and 
is the only actuator that is activated, the user may experience a stronger vibration on the side of 
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the touchpad having the actuator than on the opposite side of the touchpad. Different 
magnitudes and localized effects can be obtained by activating some but not all of the actuators. 
Since the tip of a user*s finger that is touching the pad is fairly sensitive, the output forces do not 
have to be of a high magnitude for the haptic sensation to be effective and compelling. 

Besides using a finger to contact the touchpad, the user may also hold other objects that 
directly contact the touchpad. Any haptic sensations output on the pad can be transmitted 
through the held object to the user's hand^For example, the user can hold a stylus having a point 
that contacts the touchpad 16 more precisely than a fibtiger. Other objects may also be used. In 
some embodiments, specialized objects can be used to enhance the haptic sensations. For 
example, a stylus or other object having a flexible portion or compliance may be able to magnify 
at least some of the touchpad haptic sensations as experienced by the user. 

The piezo-el^tric actuators 42 have several advantages for the touchpad 16. These 
actuators can be made very thin and small, allowing their use in compact housings that are 
typical for portable electronic devices. They also require very low power, and are thus suitable 
for devices with Umited power (e.g., powered by batteries). In some embodiments described 
herein, power for the actuators can be drawn off a bus connecting the computer to the touchpad 
(or touch screen). For example, if the touchpad 16 is provided in a separate housing, a Universal 
Serial Bus can connect the pad to the ComputerLand provide power from the computer to the pad 
as well as data (e.g. streaming force data, force commands, etc.). 

FIGURE 4 is a side elevational view of the embodiment 40 of the touchpad 16 of the 
present invention as shown m Fig, 3. Touchpad 16 is directly coupled to a grounded piezo- 
electric actuator 42 which operates to produce a force on the touchpad 16 when an electrical 
signal is input to the actuator. Typically, a piezo-electric actuator includes two layers which can 
move relative to each other when a current is applied to the actuator; here, the grounded portion 
of the actuator remains stationary with respect to the surrounding housing 41 while the moving 
portion of the actuator and the touchpad move with respect to the housing 41. The operation of 
piezo-electric actuators to output force based on an input electrical signal is well known to those 
skilled the art. 

The touchpad 16 can be coupled only to the actuator 42, or can be additionally coupled 
to the housing of the computer device at other locations besides the actuators 42. Preferably the 
other couplings are compliant coimections, using a material or element such as a spring or foam. 
If such coimections are not made compliant, tiien the touchpad 16 itself preferably has some 
compliance to allow portions of the pad to move in response to actuator forces and to convey the 
haptic sensations to the user more effectively. 

Suice the touchpad 16 is directly coupled to the actuator 42, any produced forces are 
directly applied to the touchpad 16. The electric signal preferably is obtained from a 
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microprocessor and any circuitry required to convert the microprocessor signal to an ^propriate 
signal for use wifli the actuator 42. 

FIGURE 5 is a side elevational view of another embodiment 50 of the present 
invention, in which the touchpad 16 is positioned on one or more springs 52. The springs 52 
couple the touchpad 16 to the rigid housing of the computer 10 and allow the touchpad 16 to be 
moved along the z-axis 56. Only a very small range of motion is required to produce effective 
pulses (jolts) or vibrations on the pad 16. Stops (not shown) can be positioned to limit the travel 
of the touchpad 16 to a desired range along the z-axis. 

An actuator 54 is also coupled to the touchpad 16 to impart forces on the touchpad and 
cause the touchpad 16 to move along the z-axis. In the present embodiment, actuator 54 is a 
linear voice coil actuator, where the moving portion (bobbin) of the actuator is directly coupled 
to the touchpad 16. The actuator 54 is grounded to the computer 10 housing and outputs a linear 
force on the touchpad 16 and thus drives the touchpad along the z-axis. A short pulse or jolt can 
be output, or the moving portion of the actuator can be oscillated to provide a vibration having a 
particular desired frequency. The springs 52 cause the touchpad 16 to return to a rest position 
after a force from the actuator causes the touchpad to move up or down. The springs can also 
provide a compliant suspension for the touchpad 16 and allow forces output by the actuator 54 to 
be amplified as explained above. Different types of spring elements can be used in other 
embodiments to couple the touchpad 16 to the rigid housing, such as leaf springs, foam, flexures, 
or other compliant materials. , _ . 

In some embodiments, the user is able to push the touchpad 16 along the z-axis to 
provide additional input to the computer 10. For example, a sensor can be used to detect the 
position of the touchpad 16 along the z-axis, such as an optical sensor, magnetic sensor, 
Polhemus sensor, etc. The position on the z-axis can be used to provide proportional input to the 
computer, for example. In addition, other types offerees can be output along the z-axis, such as 
spring forces, damping forces, inertial forces, and other position-based forces. In addition, 3-D 
elevations can be simulated in the graphical environment by moving the pad to different 
elevations along the z-axis. If the pad 16 caa be used as an analog input depending on the 
distance the entire pad is moved along the z-axis, and/or if kinesthetic (force) feedback is apphed 
in the z-axis degree of freedom, then a greater range of motion for the pad 16 along the z-axis is 
desirable. An elastomOTc layer can be provided if the touchpad 16 is able to be pressed by the 
user to close a switch and provide button or switch input to the computer 10 (e.g. using contact 
switches, optical switches, or the like). If such z-axis movement of the pad 16 is allowed, it is 
preferred that the z-axis movement require a relatively large amount of force to move flie pad at 
least initially, since such z-axis movement may not be desired during normal use of the pad by 
the user. 
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The voice coil actuator 54 preferably includes a coil and a magnet, where a current is 
flowed through the coil and interacts with the magnetic field of the magnet to cause a force on 
the moving portion of the actuator (the coil or the magnet, depending on the implementation), as 
is well known to those skilled in the art. Other types of actuators can also be used, such as a 
standard speaker, an E-core type actuator, a solenoid, a pager motor, a DC motor, moving 
magnet actuator, or other type of actuator. Furfheraiore, the actuator can be positioned to output 
linear motion along an axis perpendicular to the z-axis or along another direction different from 
the 2-axis (rotary or linear), where a mechanism converts such output motion to linear motion 
along the z-axis as is well known to those skilled in the art. 

The touchpad 16 can also be integrated with an elastomeric layer and/or a printed 
circuit board in a sub-assembly, where one or more actuators are coupled to the printed circuit 
board to provide tactile sensations to the toudipad 16. Helical springs can also be provided to 
engage electrical contacts. Or, multiple voice coil actuators can be positioned at different 
locations under the touchpad 16. 

FIGURE 6 is a side elevational view of a third embodiment 60 of the haptic touchpad 
16 of the present invention. In this embodiment, the stationary portion of the actuator is coupled 
to the touchpad 16, and the moving portion of the actuator is coupled to an inertial mass to 
provide inertial haptic sensations. 

Touchpad 16 can be compliantly mounted to the rigid housing of the computer device 
similarly to the embodiments described above. For example, one or more spring elements 62 
can be coupled between the touchpad and the housing. These springs can be helical or leaf 
springs, a compliant material such as rubber or foam, flexures, etc. 

One or more actuators 64 are coupled to the underside of the touchpad 16. In the 
embodiment of Fig. 6, a piezo-electric actuator is shown. One portion 66 of each actuator 64 is 
coupled to the touchpad 16, and the other portion 68 is coupled to a mass 70. Thus, when the 
portion 68 is moved relative to the portion 66, the mass 70 is moved with the portion 68, The 
mass 70 can be any suitable object of the desired weight, such as plastic or metal material. The 
mass 70 is moved approximately along the z-axis and is not coupled to the housing, allowing 
free motion. The motion of the mass 70 along the z-axis causes an inertial force that is 
transmitted through the actuator 64 to the touchpad 16, and the touchpad 16 moves along the z- 
axis due to the compliant coupling 62. The motion of the touchpad 16 is felt by the user 
contacting the touchpad 16 as a haptic sensation. 

In different embodiments, other types of actuators can be used. For example, a linear 
voice coil actuator as described for Fig. 5 can be used, in which an inertial mass is coupled to the 
linear-moving portion of the voice coil actuator. Other actuators can also be used, such as 
solenoids, pager motors, moving magnet actuators, E-core actuators, etc. Furthermore, a rotaiy 
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actaator can be used, where the rotary output force is converted to a linear force approximately 
along the z-axis. For example, the rotary force can be converted using a flexure. 

In the preferred linear force implementation, the direction or degree of freedom that the 
force is appUed on the touchpad with respect to the inertial mass is important If a significant 
component of the force is apphed in the planar workspace of the touchpad (i.e., along the X or Y 
axis) with respect to the inertial mass, a short pulse or vibration can interfere with the user's 
object motion in one or both of those planar degrees of freedom and thereby impair the user's 
abiUty to accurately guide a controlled graphical object, such as a cursor, to a given target. Since 
a primary function of the touchpad is accurate targeting, a tactile sensation that distorts or 
impairs targeting, even mildly, is imdesirable. To solve this problem, the touchpad device of the 
present invention appUes inertial forces substantially along the Z axis, orthogonal to the planar X 
and Y axes of the touchpad surface. In such a configuration, tactile sensations can be apphed at 
a perceptually strong level for the user without impairing the ability to accurately position a user 
controlled graphical object in the X and Y axes of the screen. Furthermore, since the tactile 
sensations are directed in a third degree of freedom relative to the two-dimensional planar 
workspace and display screen, jolts or pxilses output along the Z axis feel much more like three- 
dimensional bumps or divots to the user that come "out" or go "into" the screen, increasing the 
reahsm of the tactile sensations and creating a more compelling interaction. For example, an 
upwardly-directed pulse that is output when the cursor is moved over a window border creates 
the illusion that the iiser is moving a finger or other object " ovef' a bump at the window border. 

FIGURE 7 is a top elevational view of the touchpad 16 of the present invention. 
Touchpad 16 can in some embodiments be used simply as a positioning device, where the entire 
area of the pad provides cursor control. In other embodiments, different regions of the pad can 
be designated for different functions. In some of these region embodiments, eadi region can be 
provided with an actuator located under the region, while other region embodiments may use a 
single actuator that imparts forces on the entire pad 16. In the embodiment shown, a central 
cursor control region 70 is used to position the cursor. 

— The cursor control region 70 of the pad 16 can cause forces to be output on the pad 
based on interactions of the controlled cursor with the graphical envirormient and/or events in 
that environment. The user moves a finger or other object within region 70 to correspondingly 
move the cursor 20. Forces are preferably associated with the interactions of the cursor with 
displayed gr^hical objects. For example, a jolt or "pulse" sensation can be output, which is a 
single impulse of force that quickly rises to the desired magnitude and then is turned off or 
quickly decays back to zero or small magnitude. The touchpad 16 can be jolted in the z-axis to 
provide the pulse. A vibration sensation can also be output, which is a time-varying force that is 
typically periodic. The vibration can cause the touchpad 16 or portions thereof to oscillate back 
and forth on the z axis, and can be output by a host or local microprocessor to simulate a 
particular effect that is occurring in a host application. 
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Another type offeree sensation that can be output on the touchpad 16 is a texture force. 
This type of force is similar to a pulse force, but depends on the position of the user's finger on 
the area of the touchpad and/or on the location of the cursor in the graphical environment. Thus 
texture bumps are output depending on whether the cursor has moved over a location of a bump 
in a graphical object This type of force is ispatially-dependent, i.e. a force is output depending 
on the location of the cursor as it moves over a designated textured area; when the cursor is 
positioned between "bumps" of the texture, no force is output, and when the cursor moves over 
a bump, a force is output. This can be actdeved by host control (e.g., the hosrsmds the pulse 
signals as the cursor is dragged over the grating). In some embodiments, a separate touchpad 
microprocessor can be dedicated for haptic feedback with the touchpad, and the texture effect 
and be achieved using local control (e.g., the host sends a high level command with textm-e 
parameters and the sensation is directly controlled by the touchpad processor). In other cases a 
texture can be perfomied by presenting a vibration to a user, the vibration being dependent upon 
the current velocity of the user's finger (or other object) on the touchpad. When the finger is 
stationary, the vibration is deactivated; as the finger is moved faster, the frequency and 
magnitude of the vibration is increased. This sensation can be controlled locally by the touchpad 
processor (if present), or be controlled by the host. I^cal control by the pad processor may 
eliminate communication burden in some embodiments. Ottier spatial force sensations can also 
be output. In addition, any of the desoibed force sensations herein can be output simultaneously 
or otherwise combined as desired. 

Different types of graphical objects can be associated with tactile sensations. Tactile 
sensations can output on the touchpad 16 based on interaction between a cursor and a window. 
For example, a z-axis "bump" or pulse can be output on the touchpad to signal the user of the 
location of the cursor when the cursor is moved over a border of a window. When the cursor is 
moved within the window's borders, a texture force sensation can be output. The texture can be 
a series of bumps that are spatially arranged within the area of the window in a predefined 
pattern; when the cursor moves over a designated bump area, a bump force is ou^ut on the 
touchpad. A pulse or bump force can be output when Hxe cursor is moved over a selectable 
object, such as a link in a displayed web page or an icon. A vibration can also be output to 
signify a graphical object which the cursor is currently positioned over. Furthennore, features of 
a document displaying in a window can also be associated with force sensations. For example, a 
pulse can be ou^ut on the touchpad when a page break in a document is scrolled past a 
particular area of the window. Page breaks or line breaks in a document can similarly be 
associated with force sensations such as bumps or vibrations. 

Furthennore, a menu items in a displayed menu can be selected by the user after a 
menu heading or graphical button is selected. The individual menu items in the menu can be 
associated with forces. For example, vertical (z-axis) bumps or pulses can be output when the 
cursor is moved over the border between menu items. The sensations for certain menu choices 
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can be stronger than others to indicate importance or frequency of use, i.e., the most used menu 
choices can be associated with higher-magnitude (stronger) pulses than the less used menu 
choices. Also, currently-disabled menu choices can have a weaker pulse, or no pulse, to indicate 
that the menu choice is not enabled at that time. Furthermore, when providing tiled menus in 
which a sub-menu is displayed after a particular menu elemrat is selected, as in Microsoft 
Windows™, pulse sensations can be sent when a sub-menu is displayed. This can be very useful 
because users may not expect a sub-menu to be displayed when moving a cursor on a menu 
element Icons can be associated with textures, pulses, and vibrations similarly to the windows 
described above. Drawing or CAD programs also have many features which can be associated 
with similar haptic sensations, such as displayed (or invisible) grid lines or dots, control points 
of a drawn object, etc. 

In other related interactions, when a rate control or scrolling function is performed with 
the touchpad (through use of the cursor), a vibration can be displayed on the device to indicate 
that scrolling is in process. When reaching flie end of a nxmierical range that is being adjusted 
(such as volume), a pulse can be output to indicate that tiie end of the range has been reached. 
Pulse sensations can be used to indicate the location of the "ticks" for discrete values or settings 
in the adjusted range. A pulse can also be output to inform the user when the center of flie range 
is reached. Different strength pulses can also be used, larger strength indicating the more 
important ticks. In other instances, strengtii and/or frequency of a vibration can be correlated 
with the adjustment of a control to indicate current magnitude of the volume or other adjusted 
value. In other interactions, a vibration sensation can be used to indicate that a control function 
is active. Furthermore, in some cases a user performs a function, like selection or cutting or 
pasting a dociunent, and there is a delay between the button press that commands the ftmction 
and the execution of the function, due to processing delays or other delays. A pulse sensation 
can be used to indicate that the function (the cut or paste) has been executed. 

Furthermore, the magnitude of output forces on the touchpad can depend on ttie event or 
interaction in the graphical CTiviroimient. For example, the force pulse can be a differ^t 
magnitude of force depending on the type of graphical object encountered by the cursor. For 
example, a pidses of higher magnitude can be output when the cursor moves over windows, 
while pulses of lower magnitude can be output when the cursor moves over icons. The 
magnitude of the pulses can also depend on other characteristics of graphical objects, such as an 
active window as distinguished a background window, file folder icons of different priorities 
designated by the user, icons for games as distinguished from icons for business applications, 
different menu items in a drop-down menu, etc. The user or developer can also preferably 
associate particular graphical objects with customized haptic sensations. 

User-independent events can also be relayed to tiie user using haptic sensations on the 
touchpad. An event occurring within the graphical environment, such as an q>pointment 
reminder, receipt of email, explosion in a game, etc., can be signified using a vibration, pulse, or 
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other time-based force. The force sensation can be varied to signify different events of the same 
type. For example, vibrations of different frequency can each be used to differentiate differait 
events or different characteristics of events^ such as particular users sending email, ttie priority of 
an event, or the initiation or conclusion of particular tasks (e.g. the downloading of a docuxnent 
or data over a network). When the host system is "thinking," requiring the user to wait while a 
function is being performed or accessed (usually when a timer is displayed by tiie host) it is often 
a smprise when the function is complete. If the user takes his or her eyes off the screen, he or 
she may not be aware that the function is complete. A pulse sensation can be sent to indicate 
that the "thinking" is oyer. 

A software designer may want to allow a user to be able to select options or a software 
function by positioning a cursor over an area on the screen using the touchpad, but not require 
pressing a physical button or tapping the touchpad to actually select the option. Currently, it is 
problematic to allow such selection because a user has physical confimiation of execution when 
pressing a physical button. A pulse sent to the touchpad of the present invention can act as tihat 
physical confirmation without the user having to press a button or other control for selection. 
For example, a user can position a cursor over a web page element, and once the cursor is within 
the desired region for a given period of time, an associated function can be executed. This is 
indicated to the user through a tactile pulse sent to the pad 16. 

The above-described force sensations can also be used in games or simulations. For 
example, a vibration can be output when a user-controlled racing car is driving on a dirt shoulder 
of a displayed road, a pulse can be output when the car collides with another object, and a 
vaiying-frequency vibration can be output when a vehicle engine starts and rumbles. The 
magnitude of pulses can be based on the severity of a collision or explosion, the size of the 
controlled graphical object or entity (and/or the size of a different graphical object/entity that is 
interacted with), etc. Force sensations can also be output based on user-indq)endeiit events in 
the game or simulation, such as pulses when bullets are fired at the user's character. 

Other control devices or grips that can include a touchpad 16 of the present invention in 
its housing include a gamepad, mouse or trackball device for manipulating a cursor or other 
graphical objects in a computer-generated environment; or a pressure sphere or the like. For 
example, the touchpad 16 can be provided on the housing of a computer mouse to provide 
additional input to the host computer. Furthermore, selective distmbance filtering of forces, as 
described in U.S. Patent No. 6,020,876, and shaping of force signals to drive the touchpad with 
impulse waves as described in Patent No. 5,959,613, can be used with the present invention. 
Such impulses are also effective when driven with stored power in a battery on the computer 10 
or firom a bus such as USB coimected to a host computer. 

The touchpad 16 can also be provided with different control regions that provide separate 
input firom the main cursor control region 70. In some embodiments, the different regions can be 
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physically maiked with lines, borders, or textures on the surface of the pad 16 (and/or sounds 
from the computer 10) so that the user can visually, audibly, and/or or tactilely tell which region 
he or she is contacting on the pad. 

For example, scroll or rate control regions 62a and 62b can be used to provide input to 
perform a rate control task, such as scroUing documents, adjusting a value (such as audio 
volume, speaker balance, monitor display brightness, etc.), or paiming/tilting the view in a game 
or virtual reality simulation. Region 62a~can be used by placing a finger (or other" Dbject) within 
the region, where the upper portion of the region will increase the value, scroll up, etc., and the 
lower portion of the region will decrease the value, scroll down, etc. In embodiments that can 
read the amount of pressure placed on the pad 16, the amount of pressure can directly control the 
rate of adjustment; e.g., a greater pressure will cause a docinnent to scroll faster. The region 62b 
can similarly be used for horizontal (left/right) scrolling or rate control adjustment of a different 
value, view, etc. 

Particular hsptic effects can be associated with the control regions 62a and 62b. For 
example, when using the rate control region 62a or 62b, a vibration of a particular frequency can 
be output on the pad 16. In those embodiments having multiple actuators, an actuator placed 
directly under the region 62a or 62b can be activated to provide a more localized tactile sensation 
for the "active" (currently used) region. As a portion of a region 62 is pressed for rate control, 
pulses can be output on the pad (or region of the pad) to indicate when a page has scroll by, a 
particular value has passed,- etc. A vibration can also be continually output, while the. user 
contacts the region 62a or 62b. 

Other regions 64 can also be positioned on the touchpad 16. For example, each of 
regions 64 provides a small rectangular area, like a button, which the user can point to in order to 
initiate a function associated with the pointed-to region. The regions 64 can initiate such 
computer functions as running a program, opening or closing a window, going ''forward** or 
"back" in a queue of web pages in a web browser, powering the computer 10 or initiating a 
"sleep" mode, checking mail, firing a gun in a game, cutting or pasting data from a buffer, 
selecting a font, etc. The regions 64 can duplicate fimctions and buttons provided in an 
application program or provide new, different functions. 

Similarly to regions 62, the regions 64 an each be associated with h^tic sensations; for 
example, a region 64 can provide a pulse sensation when it has been selected by the user, 
providing instant feedback that the function has been selected. Furthermore, the same types of 
regions can be associated with similar-feeling haptic sensations. For exanq)le, each word- 
processor related region 64 can, when pointed to; cause a pulse of a particular strength, while 
each game-related region can provide a pulse of different strength or a vibration. Furthermore, 
when the user moves the pointing object from one region 62 or 64 to another, a haptic sensation 
(such as a pulse) can be output on the pad 16 to signify that a region border has been crossed. 
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In addition, the regions are preferably programmable in size and shape as well as in the 
function with which they are associated. Thus, the functions for regions 64 can change based on 
an active application program in the graphical environment and/or based on user preferences 
input to and/or stored on the computOT 10. Preferably, the size and location of each of the 
regions can be adjusted by the user or by an application program, and any or all of the regions 
can be completely removed if desired. Furtheraiore, the user is preferably able to assign 
particular haptic sensations to particular areas or types of areas based on types of functions 
associated with those areas, as desired. Different haptic sensations can be designed in a tool 
such as Immersion Studio™ available from hnmersion Corp. of San Jose, CA. 

It should be noted that the regions 62 and 64 need not be physical regions of the touchpad 
16. That is, the entire touchpad 16 surface need merely provide coordinates of user contact to 
the processor of the computer and software on the computer can designate where different 
regions are located. The computer can interpret the coordinates and, based on the location of the 
user contact, can interpret the touchpad input signal as a cursor control signal or a different type 
of signal, such as rate control, button function, etc. The local touchpad microprocessor, if 
present, may alternatively interpret the function associated with tiie user contact location and 
report appropriate signal or data to the host processor (such as position coordinates or a button 
signal), thus keeping the host processor ignorant of the lower level processing. In other 
embodiments, the touchpad 16 can foe physically designed to output different signals to the 
computer based on different regions marked on the touchpad surface that are contacted by the 
user; e.g. each region can be sensed by a different sensor or sensor array. > - 

FIGURES 8a and 8b are top plan and side cross-sectional views, respectively, of another 
computer device embodiment 80 including a form of the haptic touchpad 16 of the present 
invention. Device 80 is in the form of a portable computer device such as "personal digital 
assistant" (PDA), a "pen-based" computer, "electronic book", or similar device (collectively 
known as a "personal digital assistant" or PDA herein). Those devices which allow a user to 
input information by touching a display screen or readout in some fashion are primarily relevant 
to this embodiment of the present invention. Such devices can include the Palm Pilot firom 
3Com Corp., the Newton fiom Apple Computer, pocket-sized computer devices from Casio, 
Hewlett-Packard, or other manufacturers, cellular phones or pagers having touch screens, etc. 

In one embodiment of a device 80, a display screen 82 typically covers a large portion of 
the surface of the computer device 80. Screen 82 is preferably a flat-panel display as is well 
known to those skilled in the art and can display text, images, animations, etc.; in some 
embodiments screen 80 is as functional as any personal computer screen. Display screen 82 is 
preferably a "touch screen" that includes sensors which allow the user to input information to 
the computer device 80 by physically contacting the screen 80 (i.e. it is another form of planar 
"touch device" similar to the touchpad 16). For example, a transparent sensor film can be 
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overlaid on the screen 80, where the film can detect pressure from an object contacting flie fihn. 
The sensor devices for implementing touch screens are well known to those skilled in the art. 

The user can select graphically-displayed buttons or other gi^hical objects by pressing a 
finger or a stylus to the screen 82 at the exact location where the graphical object is displayed. 
FurthOTnore, some embodiments allow the user to "draw" or "write" on the screen by 
displaying graphical "ink" images 85 at locations where the user has pressed a tip of a stylus, 
finger, or other object. Handwritten charactCTS can be recognized by software running on the 
device microprocessor as commands, data, or other input In other embodiments, the user can 
provide input additionally or altematively through voice recognition, where a microphone on the 
device inputs the user's voice which is translated to appropriate commands or data by software 
nmning on the device. Physical buttons 84 can also be included in the housing of the device 80 
to provide particular commands to the device 80 when the buttons are pressed. Many PDA's are 
characterized by the lack of a standard keyboard for character input from the user, rather, an 
alternative input mode is used, such as using a stylus to draw characters on the screen, voice 
recognition, etc. However, some PDA's also include a fully-fimctional keyboard as well as a 
touch screen, where the keyboard is typically much smaller than a standard-sized keyboard. In 
yet other embodiments, standard-size laptop computers with standard keyboards may include 
flat-panel touch-iiq)ut display screens, and such screens (similar to screen 12 of Fig, 1) can be 
provided with h^tic feedback according to the present invention. 

In the present invention, the touch screen 82 provides haptic feedback, to .the user 
similarly to the touchpad 16 described in previous embodiments. One or more actuators 86 can 
be coupled to the imderside of the touch screen 82 to provide haptic feedback such as pulses, 
vibrations, and textures; for example, an actuator 86 can be positioned near each comer of the 
screen 82, as shown in Fig. 8a. Other configurations of actuators can also be used. The user can 
experience the haptic feedback through a fing^ or a held object such as a stylus 87 that is 
contacting the screen 82. 

As shown in Fig. 8b, the touch screen 82 is preferably coupled to the housing 88 of the 
device 80 by one or more spring or compUant elements 90, such as helical springs, leaf springs, 
flexures, or compliant material (foam, rabber, etc.) The compliant element allows the touch 
screen 82 to move approximately along the z-axis, thereby providing haptic feedback similarly 
to the touchpad embodiments described above. Actuators 86 can be piezo-electric actuators, 
voice coil actuators, or any of the other types of actuators described above for the touchpad 
embodiments. As shown in Fig. 8b, the actuators 86 are directly coupled to the touch screen 82 
similarly to the touchpad embodiment of Fig. 3; altematively, an inertial mass can be moved to 
provide inertial feedback in the z-axis of the touch screen, similarly to the touchpad embodiment 
of Fig. 6. Other features described above for flie touchpad are equally appUcable to the touch 
screen embodiment 80. 
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In tiie embodiments of touch input devices (touchpad and touch screen) described herein, 
it is also advantageous that contact of the user is detected by the touch input device. Since haptic 
feedback need only be output when the user is contacting the touch device, this detection allows 
haptic feedback to be stopped (actuators ''turned ofiP') when no objects are contacting the touch 
input device. This feature can conserve battery power for portable devices. If a local touch 
device microprocessor (or similar circuitry) is being used in the computer, such a microprocessor 
can turn off actuator output when no user contact is sensed, thus alleviating the host processor of 
additional computational burden. 

While this invention has been described in temis of several preferred embodiments, it is 
contemplated that alterations, permutations, and equivalents thereof will become apparent to 
those skilled in the art upon a reading of the specification and study of the drawings. For 
example, many different types of actuators can be used to output tactile sensations to the user. 
Furthermore, many of the features described in one embodiment can be used interchangeably 
with other embodiments. Furthermore, certain terminology has been used for the puiposes of 
descriptive clarity, and not to limit the present invention. 

What is claimed is: 
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CLAIMS 

1 . A haptic feedback touch control for inputting signals to a computer and for outputting 
forces to a user of the touch control, the touch control comprising: 

a touch input device including an approximately planar touch surface operative to input a 
position signal to a processor of said computer based on a location on said touch surface which 
said user contacts, said position signal representing a location in two dimensions, wherein said 
computer positions a cursor in a graphical environment displayed on a display device based at 
least in part on said position signal; and 

at least one actuator coupled to said touch input device, said actuator outputting a force 
on said touch input device to provide a haptic sensation to said user contacting said touch 
surface, wherein said actuator outputs said force based on force information output by said 
processor, said actuator outputting a force directly on said touch input device. 

2. A haptic feedback touch control as recited in claim 1 wherein said touch input device 
is a touchpad, said touchpad being separate from a display screen of said computer. 

3. A haptic feedback touch control as recited in claim 1 wherein said touch input device 
is included in a display screen of said computer as a touch screen. 

4. A haptic feedback touch control as recited in claim 1 wherein said touch input device 
is integrated in a housing of said computer. 

5. A haptic feedback touch control as recited in claim 4 wherein said computer is a 
portable computer. 

6. A haptic feedback touch control as recited in claim 1 wherein said touch input device 
is provided in a housing that is separate from said computer. 

7. A haptic feedback touch control as recited in claim 1 wherein said user contacts said 
touch smiace with a finger of said user, 

8. A haptic feedback touch control as recited in claim 1 wherein said user contacts said 
touch surface with a physical object held by said user. 

9. A haptic feedback touch control as recited in claim 8 wherein said physical object is a 

stylus. 
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10. A haptic feedback touch control as recited in claim 1 wherein said touch iaput device 
is integrated in a housing of a handheld device operated by at least one hand of a user. 


11. A haptic feedback touch control as recited in claim 10 wherein said handheld device 
is a remote control device for controlliag functions of an electronic device or appliance. 

12. A haptic feedback touch control as recited in claim 1 wherein said at least one 
actuator is a first actuator, and further-comprising at least one additional actuator coupled to said 
touch input device for outputting a force on said touch input device. 

13. A haptic feedback touch control as recited in claim 1 wherein said force is a liuear 
force output approximately perpendicularly to a plaue of said touch surface of said touch input 
device. 

14. A haptic feedback touch control as recited in claim 13 wherein said actuator is a 
linear actuator that provides an output force in a linear degree of fi-eedom, and wherein said 
actuator is rigidly coupled to said touchpad and rigidly coupled to a groimded housing. 

15. A haptic feedback touch control as recited in claim 13 wherein said actuator is a 
rotary actuator that provides an output force in a rotary degree of freedom, said output force 
being converted to said linear force on said touch input device. 

16. A haptic feedback touch control as recited in claim 1 wherein said actuator includes 
a piezo-electric actuator. 

17. A haptic feedback touch control as recited in claim 1 wherein said actuator includes 
a voice coil actuator. 

18. A haptic feedback touch control as recited in claim 1 wherein said actuator includes 
a pager motor. 

19. A haptic feedback touch control as recited in claim 1 wherein said actuator includes 
a solenoid. 

20. A haptic feedback touch control as recited in claim 1 further comprising a touch 
device microprocessor sq>arate from said processor and providing control signals to control said 
actuator. 

21. A haptic feedback touch control as recited in claim 1 wherein said actuator outputs a 
vibration or a pulse tactile sensation on said touch input device. 

22. A h^tic feedback touch control as recited in claim 1 wherein said touch input device 
includes a plurality of different regions, wherein at least one of said regions provides said 
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position signal and at least one other region provides a signal that is used by said computer to 
control a different function. 

23. A haptic feedback touch control as recited in claim 22 wherein said different 
function includes a rate control function of a value. 

24. A haptic feedback touch control as recited in claim 22 wherein said different 
function includes a button press. 

25. A haptic feedback touch control as recited in claim 22 wherein at least one of said 
regions is associated with a diflferait haptic sensation output on said touch input device than 
another one of said regions. 

26. A haptic feedback touch control as recited in claim 22 wherein a haptic sensation is 
output when said user moves a contacting object &ora one of said regions to anodier one of said 
regions. 

27. A haptic feedback touch control as recited in claim 1 further comprising a sensor for 
detecting motion or position of said touch input device approximately perpendicularly to said 
touch surface, wherein an input signal based on said detected motion or position is sent to said 
computer. 

28. A haptic feedback touch control as recited in claim 1 wherein said processor outputs 
said force information to provide said haptic sensation in accordance with an interaction of said 
cursor with a graphical object in said graphical environment. 

29. A haptic feedback touch control as recited in claim 1 wherein a menu is displayed in 
said graphical environment, wherein when said cursor is moved between menu elements in said 
menu, a pulse is output on said touch input device, said pulse causing said touch input device to 
move along said z-axis and conveyiag said pulse to said user contacting said touch surface. 

30. A haptic feedback touch control as recited in claim 1 wherein an icon is displayed in 
said graphical environment, wherein when said cursor is moved over said icon, a pulse is output 
on said touch input device, said pulse causing said touch input device to move along said z-axis 
and conveying said pulse to said user contacting said touch surface. 

31. A haptic feedback touch control as recited in claim 1 wherein a menu is displayed in 
said graphical environment, wherein when said cursor is moved between menu elements in said 
menu, a pulse is output on said touch input device, said pxilse causing said touch input device to 
move along said z-axis and conveying said pulse to said user contacting said touch surface. 

32. A haptic feedback touch control as recited in claim 1 wherein a web page is 
displayed in said graphical environment and a hyperlink is displayed on said web page, wherein 
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when said cursor is moved over said hyperlink, a pulse is output on said touch input device, said 
pulse causing said touch input device to move along said z-axis and conveying said pulse to said 
user contacting said touch surface. 


33. A haptic feedback touch control for inputting signals to a computer and for 
outputting forces to_ a user, of the touch control, the touch control comprising: 

a touch input device including an approximately planar touch surface operative to input a 
position signal to a processor of said computer based on a location on said touch surface which 
said user contacts, said position signal representing a location in two dimensions, wherein said 
computer positions a cursor in a graphical environment displayed on a display device based at 
least in part on said position signal; and 

an actuator coupled to said touch input device, said actuator coupled to an inertiai mass, 
wherein said actuator outputs an inertiai force approximately along an axis perpaidicular to said 
planar touch surface, wherein said inertiai force is transmitted through said touch input device to 
said user contacting said touch surface. 

34. A haptic feedback touch control as recited in claim 33 wherein said actuator is a 
linear actuator that moves said ineatial mass bi-directionally along a linear axis that is 
substantially perpendicular to said planar touch surface. 

35. A haptic feedback touch control as recited in claim 33 wherein said touch niput 
device is a touchpad separate from a display screen of said computer. 

36. A haptic feedback touch control as recited in claim 33 wherein said touch input 
device is included in a display device of said computer to provide a touch screen. 


.37. A method for providing haptic feedback to a touch input device that provides input 
to a computer device, said computer device implementing a graphical environment, the method 
comprising: 

providing said touch input device that is contacted by a user, said touch input device 
including at least one sensor for determining a location of said contact on a planar surface of said 
touch input device by said user and providing said computer device with a position signal 
indicating said location, wherein said computer device positions a cursor in said grq)hical 
environment based at least in part on said position signal; and 
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providing an actuator coupled to said touch input device, said actuator receiving control 
signals derived from force information output by said computer device, wherein said force 
infonnation causes said actuator to output a force on said touch input device, said force being 
correlated with an interaction occurring in said graphical environment between said cursor and a 
different graphical object. 

38. A method as recited in claim 37 wherein said force output on said touch input device 
is a linear force approximately perpendicular to said surface of said touch input device. 

39. A method as recited in claim 37 wherein a touch device microprocessor, separate 
from a host processor of said computer device, receives said force infonnation from said host 
processor and causes said control signals to be sent to said actuator. 

40. A method as recited in claim 37 wherein said interaction occurring in said graphical 
environment includes a colUsion between said cursor and said different graphical object. 

41. A method as recited in claim 37 wherein said interaction occurring in said graphical 
environment includes a selection of said different graphical object by said cursor, wherein said 
different graphical object is one of an icon, a window, and a menu item. 

42. A method as recited in claim 37 wherein said touch input device is moveable along 
an axis approximately perpendicular to said planar surface of said touch input device, wherein 
said movement along said axis is sensed and information representative of said movement is sent 
to said computer device. 

43. A method as recited in claim 37 wherein said computer device is portable, said touch 
input device is integrated in a housing of said computer device, and said actuator is a piezo- 
electric actuator. 
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